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DETAILED ACTION 
Allowed and Allowable Subject Matter 

1. Claims 6-12, 14-18, 21, 24-27, 31 and 39 are objected to as being dependent upon 
rejected base claims, but would be allowable if rewritten in independent form including 
all of the limitations of the base claim and any intervening claims. 

2. The following is a statement of reasons for the indication of allowable subject 
matter: No prior art suggests or implies, in a method of forming a high spatial resolution 
perspective rendering from a low spatial resolution voxel data set, calculating said surface 
lighting contribution during ray casting (claim 6); providing an index array indicating for 
at least some of said voxels if a class-boundary does not pass near the voxel (claim 8); 
calculation of surface lighting in the determination of the surface lighting contribution 
(claim 12); sampling points are separated by a step size which is dependent on the opacity 
value at the sampling points (claim 14); providing a definition of voxel value intervals for 
each class prior to said ray casting (claim 18); cubic interpolation for nearby points and 
linear interpolation for far points (claim 21); performing (f) in claim 1 wherein (f) 

comprises sparely casting rays and determining whether to cast one additional ray 

J 

between cast rays (claim 24); wherein the density of raycasting is progressively 
increasing and additional cast rays are cast to progressively generate nested levels of 
resolution in the fomied image (claim 31); and accumulation of opacity comprises 
updating a storage value CT as follows: CT=CT*T^step_size, where T is a transparency 
value corresponding to the opacity value (claim 39). Claim 7 is allowable because claim 
6 is allowable; claims 9-11 are allowable because claim 8 is allowable; claim 15-17 are 
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allowable because claim 14 is allowable; and claims 25-27 are allowable because claim 
24 is allowable. 

Claim Rejections - 35 USC§103 

3. The following is a quotation of 35 U,S,C. § 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was 
made. 

4. Claims 1-5, 13, 22-23, 29, 32-38, 41-49 and 51-52 are rejected under 35 
U.S.C. 103(a) as being unpatentable by Foley et al, Computer Graphics: Principles and 
Practice Second Edition in C ("Foley"). 

5. Foley, a computer graphics textbook, discloses, with respect to claim 1 , a method 
of forming a high spatial resolution perspective rendering from a low spatial resolution 
voxel data set, comprising: 

(a) raycasting at least one ray from a predetermined location (eyepoint, p. 1036, last 
paragraph, second sentence) into the voxel space (p. 1036, last paragraph, second 
sentence) by sampling points along said ray in a space (p. 1036, last paragraph, second 
sentence). 

(b) accumulating the effect of opacity along the ray path (p. 1036, last paragraph, second 
sentence), using opacity values at said sampling points (p. 1036, last paragraph, third 
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sentence; opacity values are "used" to decide when R, G, B and O values should no 
longer be accumulated), into a ray storage value (p. 1036, last paragraph, third sentence; 0 
value is compared to 1 in an effort to decide when to stop accumulation of R, G, B and O 
values), 

(c) associating points along the cast ray with material classes (p. 1036, last paragraph, 
second sentence; any R, G, B or O value, or a combination of same, corresponding to a 
point sampled by the ray, constitutes a "material class" ); 

(d) determining if a ray passes from a point in a first material class to a point in a second 
material class (p. 1036, last paragraph, second sentence; if any R, G, B or O value, or 
combination of same, corresponding to a point sampled by the ray, constitutes a "material 
class", then a ray sampling R, G, B and 0 values from one point to another is "passing 
from a point in a first material class to a point in a second material class"); 

(e) accumulating a surface lighting contribution associated with a boundary between the 
two classes into said ray storage value if the ray is determined to pass between classes 
(Foley does not specifically disclose accumulating a surface lighting contribution. 
However, p. 1036, last paragraph, second sentence, discloses a boundary between two 
material classes (see the rejection of 1(c) above for the disclosure in Foley of material 
classes, and a boundary is disclosed because the dictionary definition of a boundary is a 
separation between two groups, or classes) and passing between classes (see the rejection 
of claim 1(d) above). Therefore, it would have been obvious to one skilled in the art at 
the time this invention was made that if any R, G, B or O value, or combination of same, 
corresponding to a point sampled by the ray, constitutes a "material class", then the 
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average of visualization values between any two adjacent points separated by a boundary 
can constitute a "surface lighting contribution'*); 

(f) repeating at least (a), (b), (d) and (e) for a plurality of cast rays (p.l036, last paragraph, 
second sentence; starting this sentence with the words "for each ray" renders obvious the 
likelihood the expectation that a plurality of rays will be cast); and 

(g) forming a high spatial resolution perspective rendering from said determining ray 
storage values ("Ray-tracing architectures", p.910-1 1, especially "Component 
parallelism"; extremely realistic images are obvious examples of high spatial resolution 
perspective rendering). 

6. Concerning claims 2 and 3, Foley discloses determining the location of 
boundaries set at a position between two points of different material opacity classes 
during ray casting (p. 1036, last paragraph, second sentence; if any R, G, B or O value, or 
combination of same, corresponding to a point sampled by the ray, constitutes a "material 
class", then the separation between each point sampled by the ray constitutes a boundary, 
and boundaries are set at a position between two points of different material opacity 
classes). 

7. With respect to claim 4, Foley discloses boundaries between material opacity 
classes determined by examining at least one additional sampling point between the two 
points of different classes (p. 1036, last paragraph, second sentence; if any R, G, B or O 
value, or combination of same, corresponding to a point sampled by the ray, constitutes a 
"material class", then the sampling of any point between two other points on the ray 
fulfills this claim). 
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8, Concerning claim 5, Foley discloses examining at least one additional sampling 
point between the points of different classes comprising repeating examining sampling 
points between points of different classes until a desired precision of boundary 
determination is achieved (p. 1036, last paragraph, second sentence; if any R, G, B or O 
value, or combination of same, corresponding to a point sampled by the ray, constitutes a 
"material class", then the boundary has been determined with a precision: the boundaries 
enclose one point sampled on the ray). 

9, Regarding claim 1 3, Foley discloses stopping ray casting if said accumulated 
opacity is over a threshold at p. 1036, last paragraph, third sentence. 

10, Concerning claim 22, Foley does not specifically disclose the predetermined 
location from which the ray is cast as being within the voxel, but the disclosure of this 
element is obvious because even if a ray starts from a predetermined location outside the 
voxel, it passes through voxels, which means at one point it is inside a voxel space 
continuing through the voxel space. At that point the determining location is within the 
voxel space. (See p. 1036, last paragraph, second sentence). 

1 1 , Regarding claim 23, Foley discloses the voxel data set comprising a medical 
imaging data set ("the volume array of data representing the field", p. 1038, first full 
paragraph, second sentence). 

12, Conceming claim 29, Foley does not explicitly disclose progressively increasing 
the density of raycasting. But it would be obvious to one skilled in the art at the time this 
invention was made to progressively increase the density of raycasting because the second 
paragraph of p. 793 describes a procedure in which rays are sent from each light source as 
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a preprocessing measure, then a conventional ray is then cast which would reasonably be 
more focused with the ability to penetrate denser objects. 

13. With respect to claim 32, Foley discloses rendering a formed perspective in a 
display (Plate I.l). 

1 4. Regarding claim 33, Foley discloses defining a window in or near the voxel space 
through which to cast rays (Figure 15.55, p.701). 

1 5 . Foley does not specifically disclose a window through which rays are that is 
perpendicular to a provided orientation vector (claim 34), a flat, rectangular window 
(claim 35), a curved window (claim 36), a window defined by pixels in a uniformly 
shaped rectangular grid (claim 37), or a window defined by pixels using coordinates 
which are one of circular coordinates, elliptical coordinates and another conic projection 
of coordinates (claim 38). 

1 6. However, Foley describes ray casting as "determin[ing] the visibility of surfaces 
by tracing imaginary rays of light from the viewer 's eye to objects in the scene" (Section 
15.10, p.701, italics added by examiner for emphasis). In the same section (Fig. 15.56), 
ray casting is accomplished through a window. Foley also presents tracing rays of light 
from a light source as an example of ray casting (p.793). Therefore, since examples can 
be presented in everyday life of each type of window disclosed in claims 34-38, and Foley 
discloses ray casting through a window, it would be obvious to one skilled in the art at the 
time the invention was made that ray casting could be accomplished through virtually any 
type of window. Therefore claims 34-38 are rejected. 

1 7. Concerning claim 4 1 , Foley discloses the voxel data set generated by one of CT 
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(Computerized Tomography), MRI (Magnetic Resonance Imaging), Ultrasound, a 
geophysical survey, a meterological survey, a scientific simulation, an animation model 
having more than two dimensions and a set of simultaneous equations (CT; see p. 1038, 
first full paragraph, and p. 1039, first full paragraph). 

18. Regarding claim 42, Foley discloses each voxel having associated therewith a 
visual representation value (composite colors and opacities) and comprising determining 
a visualization value (color/opacity) associated with a sampled point from the voxel 
associated visual representation values; and accumulating said point associated 
visualization value into said stored value (p. 1038, third full paragraph). 

18. With respect to claims 43 and 44, Foley discloses the visual representation value 
associated with the voxel as being a gray scale (claim 43)/color value (claim 44)(p.l038, 
first full paragraph). 

1 9. With respect to claim 45, Foley does not explicitly disclose accumulating said 
point associated visualization values by selectively accumulating values based on front 
surface detection. However, it would be obvious to a person skilled in the art to 
accumulate visualization values based on front surface detection because the first 
sentence of Section 15.10, p.701, states that raycasting determines the visibility of 
surfaces by tracing imaginary rays of light from the viewer's eye to the objects in the 
scene. Presumably this would mean the front surfaces of the objects. 

20. Concerning claims 46 and 47, Foley discloses said point associated visualization 
value comprising a volume lighting value (claim 46)/surface hghting value (claim 47) 
(p. 1038, first full paragraph — color always has a lighting value, and when a volume is lit 
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2 1 . With respect to claim 48, Foley discloses the advancement along a ray 
coordinated with an opacification process (p. 1036, last paragraph). 

22. Concerning claim 49(a), Foley discloses the voxel data set ("the volume array of 
data representing the field", p. 1038, first fiiU paragraph, second sentence) and the 
existence of memory to store the voxel data set is inherent; regarding claim 49(b), it 
would have been obvious at the time this invention was made to use a computer 
processor for applying the method of forming a high spatial resolution perspective 
rendering fi-om a low spatial resolution voxel data set, and with respect to claim 49(c), it 
would have been obvious to disclose a second memory for storing said formed 
perspective rendering. At the time this invention was made, the use of computer 
processors and memory for high spatial resolution perspective rendering was assumed. 

23. Regarding claim 5 1 , Foley discloses determining using opacity values of points if 
a ray passes fi^om a point in a first material class to a point in a second material class 

(p. 1036, last paragraph, second sentence: if any R, G, B or O value, or combination of 
same, corresponding to a point sampled by the ray, constitutes a "material class", then a 
ray sampling R, G, B and O values from one point to another is "passing fi-om a point in a 
first material class to a point in a second material class"; and, if an opacity value is being 
accumulated, it is being "used"). 

24. With respect to claim 52, Foley discloses the material classes belonging to a 
pluraHty of material classes (p. 1036, last paragraph, second sentence: if any R, G, B or O 
value, or combination of same, corresponding to a point sampled by the ray, constitutes a 
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"material class", then a ray sampling two or more points has come in contact with a 
plurality of material classes). 

25. In view of the foregoing, the examiner concludes that claims 1-5,13, 22-23, 29, 
32-38, 41-49 and 51-52 are rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Foley. 

26. Claims 19-20 and 28 are rejected under 35 U.S.C. § 103(a) as being unpatentable 
over Foley and further in view of Knittel et al. ("Knittel," U.S. Pat. No. 6,297,799). 

27. Foley does not disclose, with respect to claim 19, the opacity value of at least 
some of the sampling points determined by interpolating between voxels near said point 
and transforming said interpolated voxel value into an opacity value for said point. These 
elements are taught by the Knittel real-time volume rendering system. Interpolating 
between voxels at said point is disclosed at col.4, 11.32-43, and transforming said 
interpolated voxel value into an opacity value for said point is disclosed at col.4, 11.20-31. 

28. Therefore, it would have been obvious to one of ordinary skill in the art to have 
modified the Foley raycasting in view of the Knittel volume rendering system. Such a 
modification to Foley would increase quaUty and realism (Knittel, col.2, 11.25-29). 

29. Regarding claim 20, it would have been obvious that interpolation would be 
dependent on a distance between said sampled point and said vantage point because the 
definition of interpolation is calculating a value between two other values which is a fixed 
distance between one value (sampled point) and the other value (vantage point). 

30. Concerning claim 28, Knittel discloses interpolating between stored values of cast 
rays at col.4, 11.18-22. 
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31. In view of the foregoing, the examiner concludes that claims 1 9-20 and 28 are 
rejected under 35 U.S.C. § 103(a) as being unpatentable over Foley in view of Knittel. 

32. Claims 30 and 40 are rejected under 35 U.S.C, § 103(a) as being unpatentable 
over Foley in view of Ogata et al. ("Ogata", U.S. Pat. No. 6,313,841). 

33. With respect to claim 40, Foley does not disclose parallel cast rays. However, this 
element is disclosed by the Ogata voliune rendering system at col.l, 11.1 1-16. 

34. Therefore, it would have been obvious to one of ordinary skill in the art to have 
modified the Foley raycasting in view of the Ogata method of casting rays in parallel. 
This would produce a two-dimensional projection of a three-dimensional dataset, 
allowing the viewer to focus on specific details (Ogata, col.l, 11.1 1-16). 

35. Concerning claim 30, Foley does not expHcitly disclose progressively increasing 
the density of raycasting. But it would be obvious to one skilled in the art at the time this 
invention was made to progressively increase the density of raycasting because the second 
paragraph of p.793 describes a procedure in which rays are sent from each light source as 
a preprocessing measure, then a conventional ray is then cast which would reasonably be 
more focused with the ability to penetrate denser objects. And Ogata discloses parallel 
cast rays. 

36. In view of the foregoing, the examiner concludes that claims 30 and 40 have been 
rendered unpatentable by Foley and Ogata. 

Response to Remarks 

37. Before a response is given to the remarks, it should be noted that the applicants' 
amendments amount to changing the term "surface lighting contribution" to "surface 
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lighting contribution" in order to use a term in the claims which is the same as the term 
used in the specification. However, since the old term "surface lighting contribution" was 
not found to be allowable, merely changing the term to "surface lighting contribution" is 
not going to make the claims allowable. 

38. With respect to the applicants' remark concerning claim 1 that Foley does not 
teach or suggest accumulating a Ughting contribution of a surface associated with a 
boundary between two classes into the ray storage value (claim 1(e)), item 7 above 
explains how Foley discloses this element. 

Action is Final 

39. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 706.07(a), 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a), 

40. A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi-om the mailing date of this action, hi the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 
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Conclusion 

Any inquiry concerning this conimunication or earlier communications from the 
Office should be directed to the examiner, Lance Sealey, whose telephone number is 
(703) 305-0026. He can be reached Monday-Friday from 7:00 am to 3:30 pm EDT. 

If attempts to reach the examiner by telephone are unsuccessftil, the examiner's 
supervisor, Mark Zimmerman, can be reached at (703) 305-9798. 

Any response to this action should be mailed to: 

MSAF 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 
or faxed to: 

(703) 872-9306 

Hand-delivered responses should be brought to Crystal Park U, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or PubUc PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
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have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 
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